Interactive Hierarchical Space Carving with Projector-based Calibrations

We present an interactive reconstruction system based on space carving. The user controls the camera and object positions and their impact on the reconstruction is immediately displayed. The flow of images is used first for silhouette carving, and then representative images are stored in a hemispherical structure for balanced color carving. Projected color points on the measured background or on the object (acquired by structured light) allow for automatic and adapted calibration of the camera. The octree object representation is central to our space carving algorithm: voxels are efficiently carved out at their largest size, images are treated at their appropriate level, and 3D regions are subdivided only when necessary. We conclude by analyzing our results and by discussing our acquired experience.